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Abstract t ExpO-rlennG.q with the CO^ilT Syslcr.n of Computer^'Asslstaf! 
Learning are reviewed in relation to five evaluaulve criterini effect 
on student learnlngi effectg on student HttitudeB, effentB on teachers 
inetltutl^ftnal eff-^cts, and cKtra-lnstitutional effects. Conclusions 
are drawn concern >g the possible future pedagogical role of computer 
assisted learning ystniB. 

^ * r 

The luipact of the tar on contemporary society has been bo great 

during the past two decades that there are few individuals living in the 
industrial nations whose daily livaB remain untouched by this aspect iof 



modem technology. Education has W£ course been markedly affected by 
computera, especially with regard to adminlstrat Inn and planning, Para-^ 
doxically, however^ methods of teaching and learning within the educational 
system have been remarkably little influenced by the computer in any 
direct sense with the obvious eKceptions of the use of computers as 
tools jPor numerical coniputation and as a means of teaching progranmiing 
skills. This state of affairs is perhaps not as surprising as it may seem 
if we examine historically the'^impact on learning of Instructional 
technology — or indeed the impact of pedagogical inndvatlons in general. 
On the whole, teaching techniques have been remarkably resistant to-change> 
and it might plausibly be argued tuat no innovation has had any substantial 
Impact on the way students, learn " at leas,t in the formal education 
system — slnf^e the invention ^of the printing press* 

COMIT is one of the most sophisticated systems pf computer^asslis ted 
Instrudtlon. 'As John Moore's introduction to this volume describes^ it 
combines the facilities of a powerful computer with a rich and versatile 
presentation mode that is capable of supplying moving colour pictures, 
complex graphics and sound. The' student's method of responding is ,alsG 
flexible s permitting communication by sonic pen or keyboard. This la an 
awesome facility, and it is consequently of liraiaense Interest to examine 
in some detail the attempts that have been made to use the COHIT system andj 
in particular,, to assess the success of the system from^an educational and 



]()■). 

f 

pucingoglcnl n tancipni n t. . hi iliin KMipiut I lu' ptt^t^Mlin^; c'piM t u i \ mw COHTT 
c;our:iu d^volopor'S hn^/o crnat i t* 1 iwanr*^ . 
Aoneg p nion t (Ir It t j t' Ijj : 

In att;oiript:ing to ev/iluato 'lOHlT, lliu c|U('HLlc)n Immudiatoly oriiscs of 
what yarclBtlcks aufi to ha udocl to judge the? o f f actlvuncufi of ouch an 

instructional system, 1 pLopo;je to \ma flvn rritGrlai Effecto on fjtudent 

\ - 
learnings Effectfi on nludent attJ.tudea^ EffGcts on teachers, InBtitutional 

effects , and Ext. ra-^inBtltutional ef f ects , 

C^) S tudsnt.>. Ltjn r nina - Thc^re will be little disagreement among teachGrs 
that a principal aim of inscruction is f.o facilitate student learning. 
Learning* however^ is not: a unitary concept, and those responsible for the 
'deaign of inBtrnction must give careful consideration to the particular 
type and level of learning it is hoped to achieve* Bloom (1956) in his 
well-known TaKunoiny of Educatiuual ObjectlveB [1] liats six types of 
l€?arnlng (Bee Table 1) and it is interesting to note that all six types are 
represented in the COMIT modules described in thr» preceding papers. 

Table 1* Types of Learning (from B. Bloom, Taxonomy of Educa tional 
Objective s, 1956) 

Knowledge ^ " of specifics • . 

---of ways and means of dealing vith specifics 

— of the unlversals and abstractions in a field 

Comprehension >^ — translation 

~ interpretation 
" extrapolation 

Application — use of rules , methods, concepts 

Analysis — of eleinents 

— of relationships 

„ of organisational principles 

Synthesi.^ conmuntcation 

~ planning 

" derivation of a set of abstract relations 

Evaluation - — internal evidence 

— ^ extendi criteria 

Of cDnsiderable interest here are the ways used by the different moduies 
^o achieve different learning ends. These range from drill-and-practlce 
♦lechniqueo and remedial Instruction, as described by Delahay to teach offen- 
sive line play in football, to fairly elaborate slmulatioiis of real-life 
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Hltuaflmm wh.uv nl.uiunfi x:h r..- lii .m) tu .irply (in- kimwl i hey liav.. 

antnlned, nchl'-vu fwrn- ;j v„ tlu-fjifs, .'.m! iVPbi.it.' I 'u: orflcnry ol t hunrm leal 
notions In r.'latlca tn tho n J mulnUM.i d.iLa. A Hf'ud uxainplij oC t:liu Inf.tcr 
appruttch l8 thompsou'a pvofefflimnu to tuach fnuvi.-y .■•nmpllng, which exploits 
a capacity in which the camputar uXLCi;! (atnr ' ng 'dctailud Informfit Joii /md 
arrungirg for Its rGtrlaval Jn a variety of diffuirunt formatu) and which 
wonld be vlrtuolly lii ponnj blu to nchlevn by any other teaching tfichnlquu 
tliat can bo used In the clflSHroom, as oppoBcd to the "real world". 

It is often, erronoouQly, HBSunicd that the. computer Bhuuld be u, .-d tn 
replicate as far as possible the function of the human toachnr, , (Indeed 
It is a common error In tyrhnological dovelopmcnt .to devlBO a machlun that 
performs Inafficicntly ev.ctly because it l3 made to ape human perforraance 
— for example the cominon idea of a robot that looks, walks, and talks like 
a human would be an incredibly incffJclnnt use of machinery for most 
purposes.) Coraputer-AsBisted Instruction (us opposed to Computer-ManaBed 
Leaking, for example) ofton tends to start from the baslH that the learning 
material should bo presented b^ the computer and confined to this mode q£ 
presentation. However, there ig no reason why the computer need play such 
a direct teaching role. It may for instance be 'uaed as a learning aid, 
much 11^8^ a dictionary or calculator, and indeed this is what Winter has 
done in Using the machine to display varloufl properties of human gait. The 

.computer Is also a conventent testing device (it was used for this purpose 
in nearly all of the COMIT inodules)' and a useful means of diagnosing each 

Xlearner's knowledge , and abilities so as to .guide students to material 

" uniquely suited to their individual needs. > 

This ability at efficient diagnosis, and the idea that the computer 
can cater to individual Icaming differences in a way that is not possible 
in the classroom, Is a potential advantage of CAL that Is frequently put 
forward, by the system's advocates., Unfortunntely in practice CAL, in conmjon 

'with previous instructlonol technologies such as programmed instruction, has 
a rather di suppointinB record of achievement. In' reality, few modules 
ppploy very sophisticated diagnosJB of student aptitudes (let alone student 
learning 'styles) and most o£ the branching techniques used for temedial , 
purposes are fairly primitive, even in comparlgon with what was possible on 
the teaching machines of IS years ago. There are good reasons why this 
potential strength of CAL has us yet gone largely unrealizedi the deficiency 
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la probably due iarB^jy to the intmiM. h- ufforL of tJmc and coii™ttmt:nf. 
. Involved to vrite ond prosrumme matcrlnl fov thio purpoan. Hence tho modules 
that in principle could cntur to ,i widu VH. Ie.ty oC Individual dif Ecarenccs , 
and which ata capablo oE continual improvement on thq basis of a detnilGd 
examination' of student responocs, may remain in a crude and unmodified form 
Indefinitely. Naturally, it is too early to say whether this, will be go for 
the prosrammes developed in COMIT. although the faet that the syntem in Its 
present form has been dismantled makes the question somewhat unfair or 

itrelevanC. ' 

If it is accepted that some deoonstration of student learnlng'is 
important, evidence of teaching succesa, then attention turns to the types 
of evidence that i t be usof for this purpose. Evaluation of any 
teaching Intervention may be carried out In terms of a change in knowledie 
or (in the case of the teachinB of a skill) behaviour compared to the 
abilities dumonstrated Immudiately prior to the start of the teachlnB. Such 
"precest - post-test" comparisonB, if they are to be meaningful, should be 
related to carefully stated learning objectiveB that can be operatlonalized 
in tGrma of specific behaviour change. (Even Chen it is often difficult 
to know whether the change was due to the teaching, to some extraneous 
factor, or a combinatian of both.) Sometimes an attempt is made to supple- 
ment evidoucu of such changes on the part of learnars by comparative 
measurements for a group of people to whom the material was p'resented in some 
other way "(or to wham it was not presenued at all). A full discussion of 
the design and shortcomingg of such evaluative strategies Is beyond the" 
scope of the present paper. Suffice it to say that several of the contri- 
butions to, the present •collection describe attempts at evaluation that 
Incorporate pre- and post-tests as well as comparisons with otker teaching 
techniques. Some general comments about just what conclusions can be drawn 
from 8\ich'atudles are made at the end of this paper. 

<b) Student Attitudes . A measurement of learners' attitudes to a system of 
insttuction. while less important than evidence of student learning, is of . 
value, not least because favourable attitudes are likely to facilitate 
learning (or, conversely, unfavourable attitudes are likely to be highly 
disadvantageous for learning) . Nearly all of the preceding papers report 
on student reactions to their experience with the COMIT system, gathered 
either by means of a structured questionnaire or from informal interaction 
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Willi the uiudulu aullior. In ofiinx l\\t\ c:niU! with ijninljliiR lunovallonfi 

(Indrod with any tuachini^ tnrhnUiUiO hn\h poHliivr nnd \u\\^ni: Is/i) nft: i LnHcn 
/ire reported* Nnj^nlivc* ccjinmcMiln rinrifi* lu Ihv rntnintony /ind hidk ui' 1 lux- 
IbiliCy of the ay5tum^ anpuctH that: dlfrcrcjni; nuthoi^n attamptiJti toflcnl wif^ti 
by different Tneanr^, such nrj humour or the provir:^jDn of oncillaty nottiri, 
Anothor feature of the gyfitem frGqucntly mentioned in a negativa voin wari 
Its iffipersonality coinpcirGd to n real, iiVQ teachur, and one attempt to 
combat thie feature and add n *human element'* to the learning Qxperlence 
Is deBGrlbed by Avedon and Rtcwart. 

This brings up the trnportant question of the '■man-inachinG inlc?rface" 
and the related, more general question of motivation in learning* Unfor- 
tunately our knowledge of the procenB by which humans relate to mchinns 
in both positive and ne^^ative ways, as well as our undarstanding of why 
iiiachlnes are exciting for uomu .individuai:^ and frighteninj> for othorii, In 
disappoint Ing to this point* nntwithstanding increasing attention by 
researchers to the qucBtlon, It Its interestings for exaniple, that mOBt of 
MCBaan'e students could spend no more than two or three hours at the COMIT 
terminal, vhlle we know that students of similar age and inte] ligence will 
spend much longer periods passively watching a somewhat similar machine 
'(television) or interacting with machines that seem on the face of it far 
less challenging (pinball machirieEij Blot machines, and so on). 

In terms of positive attitudes to COMIT, many students expressed 
pleasure at the idea of proceeding at their own pace and being able to- 
review the material presented attributes that are not confiried to CAL, 
but are greatly facilitated by such a system. In the case of favourable 
comnients to the general notion of learning via such a system (and there were 
many such comients) it is Important to recognize that there may be a con= 
founding influence caused by the very novelty of the system and the fact ^ 
that learners were part of a special eKperlment (the "Hawthorne effect") • 
On the other hand^ some of the negative comments may come from conservative 
students who are resistant to any new type of learning. FurthermoTfe the 
greatest area of negative reaction — which concerned the technical probjems 
with the system — relates to features of COMIT that could almost certnlnly 
be remedied in the future. , ^ 

; 
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(c*) lyLfcM! Uj_o n T uac 1h - ni . Tlu« atllCuiluH uf ^niLluirfi niid J iin t ri cCorfi to thu 
expurlcnca wurkinB wluh Cf>MtT n?fl :ct f:lu' unmu dlyLrnvncvt of oplnlnn nn 
do thoue of tho ritudput ItvniiiUM, ainl iaiiju* riuiii (MjniiUlc^ r«b I «> ciil liiiB l/inin 
about thu ct^nural pot imtLnl oJ tho^Hyfitrum to a inc*fiiiurc oi: dlnll Lufilt>ninont , 
with positive iittit:iidc»s pradomln/iting (perhapa not aurprifsingly. In vU'w of: 
tho need to Justify the gf^at nmuunto of tima and onnroy uxpundcd on pm- 
paring Che modulGB) * The negative cOTnmcnt:,^ were clearJ.y influeTiced by 
frustrations with technical aspects of the system (fraquent bronkdowns and 
alow reeponsa time) anH the iniTnensc amount of authoring time requlrad. 

Of even morR Interest, however, are the comments by authors about the 
teaching/learning process itself that have applicability far beyond the ^ 
COMIT oystem or computer assisted IcnrnlnK;. For example, three of the 
authors, ar^ a result of working on thn i)tuparation of their iQoduleo, soDn 
reali;scU that their knowledge ui the material and their underotauding of 
the beat way to organise the material for efficient learning', wa^^ far less 
than they had assumed at the outGeti in spite of several years of lecturing 
on basically the sanie topics. If this waa primarily' a belf-inslght , there 
were orher insights into t'ln learning process . itself . For^ example, four of 
the authors came to the leallrntion that learning is essentially an active 
process that requires students to respond constantly and frequcintly* rather 
than paseively receiving ^transmitted materlali as happens frequently in. so 
much traditional teaching. Authors also coMented on another lea.rnlng 
principie that is well known to psychologists but frequently ^ignored in the 
claseroom, the notion that effective learning requires frequent and 
iTumodiate information to students about how well they are' progressing with 
the learning task. At least one of the authors raised the important/l^ssue 
of social factors in learning, to what sKtent etudents benefit from working 
alone at their own pace as opposed to learning with and from other people, 
, Hence' McBean felt that many of his students were able to benefit from bein 
able to work in pairs when reviewing the material in the module. 

It is Important to realize that these infeights ^bout the leariiing 
process are not restricted to learning by computer,, but are generally appli- 
cable- At the same time, it is instructive to see how^ effectively /they 
were brought home by the experience of working 'with a new instructional 
Bystem, such as COMIT, that places new "demands on tihe teacher, especially 
with regard to the way he or she analyses, selects , and structures the-- 
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nmteilfil to In/inuMl. Kvnii ror r HiH'r icMuuHl loadinrri It: /M>lH^*nrn t:lwit 
involvcincnt: wlr:li n ih*w iiimH i urn ni I riHl. rue l I nil Icnjlrj to i\ rc'lh l.iiki lif^ f) f 
prlnclplttH nm\ l.nchiU quiMi prrfvluunly lakun Mntiu^wlint for ^^ranlcul. Tn thin 
extent uKporicncti with CQMLT in at unfloiihtad benefit to ihond iuvnlvncl In 
doglgnlng and adnilnifitorlng tliti dlffurent maduluB, 

(d) Inatltutlona l EllcKite . Ovar the thrive year axlotencc of the COMIT 
project there was a conslderablo outlay of Institutional funds and rasourcca 
and an even greater Investment of time on the part of the project staff and 

» module authors p not to mention the effort and Invoiveraent of the many 
hundredji of student learners • Yet the QBsentlal components of the F3ystem 
hav^ now been dlBbandcd with little likelihood rh^t the University of 
Waterloo — at le-^Bt in the ahort term — vyill change its basic methods of 
teaching. Wh/ Lb lULh the uaHes and why has this been the fate of m 
many eKperimentB In educational technology in Established educational 
InntitutionB? 

Part of the aruiwer lies in the inherent conservatiBm df acadenilCB — 
and etudents ~ when it comes tn the implementation of new methods, of 
teaching and learning. Additional reasons relate'' to the basic complement 
of skills that most faculty bring , to the teaching process^ (few faculty are 
trained in pedagogy and most learn through the examples of their own 
teachers), to the coneiderable costs Involved (to cite just one eKamplei 
the costs oi providing atid servi|ing an adequate number of terminals), and 
to the general reorgajil^atlon of the university system that would be 
required in terms of tlTOetabllng, classroom arrangement^^ and so on. 
Furtherraorap at a time when universities are threatened wlthl severe fin- 
ancial strlngeneles and the very job seeurity of university teachers is 
challenged, the political cliMte Is probably not conducive td the Intro- 
duction of a radical change in teaching methods, especially when't^G argu- 
mentf for effectiveness are equivocal. Hence In the imnedlate future 
innovations like COMIT will probably remain in the domain of experiments to 
be tried and tested in forward-looking institutions, by faculty who are 
willing to devote their .time and enthuilasm largely for the reward of their 
\^own self-satisfaction and personal insights IntQ the learning process. 

(e) EKtra- Institutional Effects , In his Introduction to this collection 

^ Moore states that one aim of the COMIT project was to see what Implicatlona 
might result from the experiment for extramural education. He points' ouC 
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that UilM nyr.K-iii (WMHiiii lo linv*> p.nt i t:ii la r pmniino lii ib-ii lUs.b^J.ilc 
nctll l(i m\ onlln/iry rnluiir inlPvt.'Hun in. )n I lor (( linii|',h Miippl '■liKMitc.l wllli n 
nuiiibtT ol ,soplilHl.l..u..,| .MhllllnnM, fHwl! nn (i I tf;lil. Ih.ii , k-yhunr^, >m\ nn ,,..) 
It; nrt-mu probMhlo, how,;vt.r, iluK /n,y Impou t:n Inl.rod.mn Hwh (i riyfitnin nn a 
wlflGsprrjnd biiHls ara ratliur prumut uro. 

In the iLvni place, tlic-rt; .ippnnr to bu roriii!<l;ib1.j Cnclinl cal nhiAacAnn 
to the ofClcloni- oporat^on of nucli n systuni, nvon when It la mad "in- 
housu" on a fairly Hmall ncnjo, and with conaCiint tecUnlcdl nfJoinuniicfi 
available to ntuclcntB uslnB unch , terininal. Kunondly, the authoring tliiiu 
rnquircd to praducu material la vaHt, cHpnnially when lU is borne in raind 
that the sesincntg rGprefianted by the moduieo described here comprinc only 
a frautlon of the mntcrlal normally prcsuntBd in the nne-tcrin coursca of 
which thoy form part. Thirdly, it i,s probablo that the outside cl iunuelQ 
for such a syatcm La prohahiy connidcfably mucii cumjerwativu about pudaKotr 
leal nmttcra than the Htudcnt body in oHtabHohed inatitutlons o£ hlnhor 
education. In this rognrd the British Open University la an Intorestlnfj 
case m point. Althoush this is a remarkable social Innovation . from a 
technoloBlcal and pedagoglcnl point of" view It in fairly orthodox, relying 
ui the traditional mainBtayH of further education ~- correspondence ^ 
courses,, personal tutors, textbooks (albeit extrcfflely ^eli orp,anl^.ed ones) ' 
and traditional lectures durins the compulsory periods in residence. ^' 
The television cainponont of the. Open University is just that — Eood tele- 
vision progranTming," Involving none of the irtteraccive element that la a 
principal feature of COMIT and CAL in general. 
COMIT and the Fu ture Role o f nomputers in Edueaclon; 

" A nuraber of the experiments with COMIT described in previous papers 
have atcempted to compare the system with other teaching methods. In the 
last analysis. h.Jwevei;, such an approach is probably unproductive. Rather, 
we should try to analyse which tnedla of instruction, including the human 
teacher, are most suited for particular jjedagogical ends and for particular 
individual learners. Tkis Is, a research question of greaC Ifflportance.^. 
abo.ut which very little is known as yet. , 

In the COMIT system the computer. It could be argued, Is best^een 
not as a teacher, but as a "super-coordinator" bf Instruction 
potentially better than the Human teacher at this task, though whether 
acceptable In this role by the human leffrner is something that has yet to 
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hr riiiirrnilntMl . (Uu'tnJiily CiiMrr If. Inr I i ntn rhiMp ;i r . . d i n.i M ti|'; nVMjmiu 
<iV«Mi thnU|;h J I i?i inr h^n; r^iXMPiivi' in thi?; riiln t linn wlicfi It Ir* u'umI ni* 
n direct Li^(K'iili\g rl<»VL(:r. It. imi'ii tlu'n ht* m'.IjmI If it Is wui I li ihl:* jio'itj 
or Wlu^thiM' wr filial] (nnrlniK* In m: ruir Mxifit liu^ iiyaiMir;, Inrj^Mly linin/iii, or 
Bomd alterriut: Ivci in iium/in, iioii (jiiiipt i tci I /ctl nyslnins fiin h /n. wrltitiM inrstlultMi 
thai: nru capnb] « oJ' guldlnH 1«'annMn U) n vnt irly til exiutlnB mnnuvcon. 

If wu acc!(V^t tin? cnmputL^r nn n Mwriw] rnuinHmitor of inn t: rue; 1 1 onn 1 
rc!FiOUt*cc3fi» tlion wt* niunl: ruuluufily cjur'Mf Inn tht* nntiiin Lluit nil rlicj mnturial. 
lnvjl\ed haa to be pror]cniL«Ml illrr^fM.ly on lUv c:nmpiiu?r Unulf, Thu ny^n urn 
will depend ultimately, I would ;.u?^;p[,t, unl nnluly on Wn ufl JcliMiry, hut 
nlflo on ItFl f l!n:Kibili.ty, This in the futurn chnlU'nH^" compute lii 
Qdiicatlon^ find an Ihuuo for whicli thu COMiT eKpnrJmunt IinM providrd 
invaluable cmplrjcnl dnta. 

[IJ B. S, BloDuu T/ymnmii2^j3f^ 

Cn^nitivo Dbirrain, McKay, Nuw York, 1936, 
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